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ABSTRACT 



The present invention is a method and apparatus for the 
enhancement of 1 bit per pixel image signals to produce a 
multiple-bit per pixel form. A binary input image is passed 
through a plurality of filters to generate level slices. The 
filters are stack filters implemented as look-up table or 
template-based filters, morphological filters, or any similar 
binary-to-binary filters that could be used to generate level 
slices. Each of the N-1 filters is used to produce the slices, 
where N is the number of possible gray-scale levels desired 
in the output image. Once the slices are generated, the 
resulting binary image data therein is recombined, by adding 
or stacking, to produce the desired multiple-bit per pixel 
output. 



5 Claims, 10 Drawing Sheets 
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STACK FILTERS FOR 1-TO-N BIT IMAGE 
PROCESSING IN ELECTRONIC PRINTERS 

This is a division, of application Ser. No. 08/241,432. 
filed May 11. 1994, now U.S. Pat. No. 5.471.320. 5 

This invention relates generally to a method and appa- 
ratus for producing a 1-to-N bit per pixel enhancement of a 
binary bitmap image, and more particularly to the use of 
template-matching stack filten to produce such enhance- 
ments for electronic printing, 10 



BACKGROUND AND SUMMARY OF THE 
INVENTION 
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The present invention focuses on image processing of 
binary images to enable such images to be printed or 
otherwise displayed at an enhanced pixel resolution. It is 
known in the art of digital printing that it is highly desirable 
to print low resolution documents in an enhanced mode. 
Moreover, template-based binary resolution enhancement 
and convenion has been addressed by others siich as R. 
Eschbach Application Ser. No. 08/169,483, H. Kang US-A- 
5,270.836. issued Dec. 14, 1993 and US-A-5,301,037, 
issued Apr. 5, 1994. and L. MaUloux US-A-5,282,057, 
issued Jan. 25, 1994, all of which are hereby incorporated by 
reference. The present invention differs from that body of 
work in that it is a method and apparams directed to 
converting a binary image to a multiple-bit-per-pixel image 
while maintaining the same spatial resolution. 

More closely related is the work of Banton and Charissis. 
in a co-pending application Ser. No. 08/241,431 filed con- 
currentiy herewith and Loce and Cianciosi in application 
Ser. No. 08/169,485, where binary bit maps are converted to 
an enhanced multibit form. Banton and Charissis focus on 
gray imaging of halfbits and ragged features by employing 
a single set of templates within a 9x9 window. A match in 
their scheme yields an output that describes how the pixel 
should be imaged. Several matches with different templates 
could occur at the same location, and when that occurs, the ^ 
resulting output is decided in an arbitration circuit More- 
over, the set of templates were designed manually over a 
long period of time. Loce and Cianciosi proposed using a 
statistically generated set of templates that transformed from 
a binary bit map to an array of pulse-width position- 
modulated (PWPM) codes, where each code was that one 
most often observed for a given input pattern in a statistical 
training process. 

In short, image processing in electronic printing is often 
called upon to take a binary bit map as input and transform 50 
it to a gray-scale image. For example, scanned documents 
are typically digitized at 8 bits/pixel and then thresholded to 
1 bit/pixel. Converting from 1 to 2 bits per pixel for 
enhancement purposes is a filtering operation that estimates 
what the image would have been had it been converted from 55 
this 8 bit representation, or some idealized 8 bit represen- 
tation, to 2 bits instead of 8 bits to 1 bit, "Descreening" a 
halftoned image is a 1-to-N bit filtering operation that yields 
an estimate of Uie gray-scale image prior to halftoning, or an 
estimate of that gray-scale image quantized in a particular go 
manner. 

Heretofore, related publications have discussed 1-to-N bit 
enhancement using morphological filters. For instance Loce 
and Dougherty, in *The Mean- Absolute-Error Theorem for 
Computational Morphology," Proc. SPIE. Vol. 2030, San 65 
Diego, July 1993, describe passing an input binary image 
tiirough parallel morphological filters, where the output of 



each filter is a "gray level slice" of the total output. The 
output slices are then stacked to form the final multibit/pixel 
image. The design method requires the filters for each layer 
to be designed simultaneously and therefore is very complex 
in a combinatoric sense. Because of the extensive compu- 
tation involved in evaluating the combinatorics, the filters 
given in the publication are limited to operate witiiin a 5 
pixel window. 

Stack filters in general are described by Wendt, Coyle and 
Gallagher "Stack Filters," IEEE ASSP-34, no. 4, pp. 
898-911, 1986, and optimization of stack filters are 
described by Lin and Coyle, "Stack Fillers and the MAE 
Criterion." IEEE ASSP-36. no, 8, pp. 1244-1254, 1988. In 
tiieir optimization scheme, to simplify the design process, 
the same filter is applied to all slices. However, tiiis simpli- 
fication renders the method ineffective for binary to gray 
enhancement. In another publication by Lin and Coyle, 
"Minimum MAE Estimation over the Class of Generalized 
Stack Filters," IEEE ASSP-38, no. 4. pp. 663-^78, 1990. 
they state that they have not been able to develop an overall 
filter that properly stacks when each layer utilizes a different 
filter. Note that stack filters are typically used for filtering 
gray-scale images, and, other than the related computation 
morphology work cited above, are not believed to have been 
described for binary to gray scale transformation. Also note 
that the stacking architecture allows for certain cost savings 
in the electronics. 

Also of interest is the pubUcation "Computational Math- 
ematical Morphology," by E. Dougherty and D. Sinha, 
University Laboratory Report MIL-92-17, Morphological 
Imaging Laboratory, Center for Imaging Science, Rochester 
Institute of Technology. This report proposes a general 
mathematical framework for performing a parallel/adding 
filtering from an arbitrary number of gray levels to another 
arbitrary number of gray levels, although the filter design 
and implementation method are not given. Also, the rela- 
tionship given to combine the output of the parallel filtering 
does not necessarily ensure the "no gap" criterion for 
stacking. Furthermore, while a design method is given in the 
reference by Loce and Dougherty, it suffers from the 
described combinatoric complexity. 

The present invention is directed to a new method for 
designing an apparatus for implementing 1-to-N bit stack 
fillers, where the design of the filters for the individual level 
slices of the stack is sufiBciently independent that the com- 
binatoric complexity is greatiy reduced, thereby enabling 
filters to be designed that employ much larger windows. For 
example, using this method, it is possible to design filters 
that employ 32 pixel windows, which pack simply into a 
single unsigned long integer representation on many com- 
puting platforms. When properly designed, an optimal stack 
filter with this large window greatiy outperforms, in an 
output image quality sense, die small window filters 
described by Loce and Dougherty, in *The Mean-Absolute- 
Error Theorem for Computational Morphology," Proc. 
SPIE, Vol. 2030, San Diego, July 1993. 

In accordance with the present invention, there is pro- 
vided a method of transforming a plurality of rasterized 
binary signals indicative of a binary input image into a 
multiple-bit-per-pixel gray-scale image, comprising the 
steps of: (a) receiving the plurality of rasterized binary 
signals; (b) filtering the rasterized binary signals to produce 
a binary level slice from each one of a plurality of level slice 
filters; and (c) combining the binary level slices to produce 
the multiple-bit-per-pixel gray-scale image. 

In accordance with another aspect of the present inven- 
tion, there is provided a method for transforming a binary 
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input image B(x,y), represented as a plurality of rasterized 
binary signals, into a multiple-fait-per-pixel gray-scale image 
comprising the steps of: (a) storing the binary input image 
B(x,y) in a fint memory M(x,y); (b) filtering the binary 
image stored in the first memory M(x,y) to produce a filtered 5 
binary image Fi(x,y); (c) storing the filtered binary input 
image Fi(x,y) in the first memory M(x,y); (d) filtering the 
binary image stored in the first memory M(x,y) to produce 
a new filtered binary image F„(x,y); and (e) stacking filtered 
binary image Fi(x,y) and new filtered binary image F„(x,y) 
to produce a gray-scale output image 0(x,y), wherein each 
of a plurality of pixels therein is represented as a two-bit 
value. 

In accordance with yet another aspect of the present 
invention, there is provided a method for transforming a 
binary input image B(x,y) into a multiple-bit-per-pixel gray- 
scale image comprising the steps of: (a) storing the binary 
input image B(x,y) in a first memory M(x,y); (b) filtering the 
binary image stored in the first memory M(x,y) to produce 
a filtered binary image Fi(x,y); (c) storing the filtered binary 
input image Fi(x,y) in the first memory M(x,y); (d) filtering 
the binary image stored in the first memory M(x,y) to 
produce a new filtered binary image F„(x,y); (e) stacking 
filtered binary image Fj(x,y) and new filtered binary image 
F„(x,y) to produce interim image I(x,y), and storing the ^ 
interim image in a second memory; (f) storing the new 
filtered binary input image F„(x,y) in the first memory 
M(x,y); (g) filtering the binary image stored in the first 
memory M(x,y) to produce a new filtered binary image 
F„(x,y); (h) stacking interim image i(x,y) and new filtered 
binary image F„(x,y) to produce a new interim image I(x.y), 
and storing the interim image in a second memory; and (i) 
repeating steps (f) through (h) above for a plurality of times 
to produce a gray-scale output image 0(x,y), wherein each 
of a plurality of pixels therein is represented as a multiple-bit ^5 
value. 

In accordance with a further aspect of the present inven- 
tion, there is provided a digital image filtering apparams, 
comprising: a first memory for storing a binary input image; 
a first level slice filter to which the stored binary image may 40 
be applied, said first level slice filter producing a primary 
binary signal in response to each pixel of the binary image 
applied thereto to produce a first-slice filter output; combi- 
nation logic for logically combining the first-slice filter 
output and the binary input image to produce an output 45 
image first-slice; a second level slice filter to which the 
output image first slice may be applied, said second level 
slice filter producing a secondary binary signal in response 
to each pixel of the output image first slice applied thereto 
to produce a second-slice filter output; combination logic for 50 
logically combining the second-slice filter output and the 
first output image slice to produce a second output image 
slice; and stacking logic for logically stacking the second 
image slice and the first image slice to produce a filtered 
image that is a multiple-bit per pixel image representing 55 
each of a plurality of binary pixels within the binary input 
image as a two-bit value. 

In accordance with another aspect of the present inven- 
tion, there is provided a digital image filtering apparatus for 
transforming a binary input image represented as a plurality 60 
of rasterized binary signals each representing an image 
pixel, into a multiple-bit per pixel gray scale image, com- 
prising: a primary level-slice filter for filtering the binary 
input image to produce a first filtered binary image; a first 
secondary level-slice filter for filtering the first filtered 65 
binary image to produce a second filtered binary image; a 
second secondary level-slice filter for filtering the first 
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filtered binary image to produce a third filtered binary 
image; and an adder for adding the first filtered binary 
image, the second filtered binary image, and the third filtered 
binary image to produce a gray-scale output image, wherein 
each of a plurality of pixels therein is represented as a 
multiple-bit value. 

In accordance with an aspect of the present invention, 
there is provided a digital image filtering ^paratus, com- 
prising: a first memory for storing a binary input image; an 
extensive level-slice filter to which the stored binary image 
may be applied, said first level-slice filter producing a first 
binary signal in response to each pixel of the stored binary 
image applied thereto to produce a first level slice image; an 
anti-extensive level-slice filter to which the stored binary 
image may be applied, said second level-slice filter produc- 
ing a second binary signal in response to each pixel of the 
stored binary image applied thereto to produce a second 
level slice image; and stacking logic for logically stacking 
the second image slice and the first image slice to produce 
a filtered image that is a multiple-bit per pixel image 
representing each of a plurality of binary pixels within the 
binary input image as a two-bit value. 

In accordance with a further aspect of the present inven- 
tion, there is provided a digital image filtering apparatus for 
transforming a binary input image represented as a plurality 
of rasterized binary signals, each representing an image 
pixel, into a multiple-bit per pixel gray scale image, com- 
prising: a first level-slice filter to which the binary input 
image may be applied, said first level-slice filter producing 
a first binary signal in response to each pixel of ±e binary 
image applied thereto to produce a first image slice; a second 
level-slice filter to which the binary input image may be 
applied, said second level-slice filter producing a secondary 
binary signal in response to each pixel of the binary image 
applied thereto to produce a second image slice; and an 
adder for adding the second image slice and the first image 
slice to produce a filtered image that is a multiple-bit per 
pixel image representing each of a plurality of pixels witliin 
the input image as a multiple-bit value. 

In accordance with yet another aspect of the present 
invention, there is provided a method for designing a stack 
filter, for enhancing a binary input image into a multiple- 
bit-per-pixel image, comprising the steps of: (a) obtaining an 
idealized gray-scale image, wherein the image contains 
strucnires representative of those likely to appear in docu- 
ments to be enhanced from binary to a multiple-bit per pixel 
gray-scale range; (b) thresholding the gray-scale image 
using a binary threshold level to produce a binary image; (c) 
thresholding the gray-scale image at a second threshold, 
preferably not equal to ±c binary threshold, to produce a 
first level slice; (d) producing, as a function of the binary 
pixel levels in the binary image and the first level slice, a first 
difference image; and (e) generating, as a function of the first 
difference image and the binary image, a first level slice filter 
having a plurality of templates that, upon receiving binary 
input signals within windowed subsets of pixel locations 
within the binary image will produce binary output signals 
equivalent to pixels at corresponding pixel positions in the 
first difference image. 

BRIEF DESCRIPTION OF THE DRAWINGS 

FIG. 1 is an example of a stack representation of an image 
signal in one dimension; 

FIG. 2 is a schematic block diagram of a general embodi- 
ment for an iteration-based slack filter that achieves the 
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DESCRIPTION OF THE PREFERRED 
EMBODIMENT 
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1-to-N bit resolution enhancement in accordance with the 
present invention; 

FIGS. 3 and 4 schematically illustrate two alternatives to 
the general embodiment of FIG. 2; 

FIG. S illustrates an extensive filter embodiment of the ^ 
generalized architecture depicted in FIG. 2; 

FIG. 6 illustrates a preferred method of performing itera- 
tion-based stack filtering in accordance with the present 
invention; 

BG. 7 shows a flowchart for a design procedure that may 
be used to generate the stack filters of FIG. 4; 

FIG. 8 illustrates an alternative embodiment of the stack 
filter Uiat employs a parallel architecture to achieve a 1-to-N 
bit resolution enhancement; 15 

FIG. 9 shows an example flowchart of the filter design 
process for a l-to-2-bit convereion filter produced in accor- 
dance with the present invention; 

FIG. 10 is a block diagram illustrating a process for 
obtaining a 2-bit per pixel bit map using the filters designed 
by the process depicted in FIG. 9; and 

FIGS. 11 and 12 illustrate two alternative methods for 
printing the resulting 2-bit-per-pixel gray-scale bit map 
produced by tiie process depicted in FIG. 10. ^ 

The present invention will be described in connection 
with a preferred embodiment, however, it will be understood 
that there is no intent to limit the invention to the embodi- 
ment described. On the contrary, the intent is to cover all 
altematives, modifications, and equivalents as may be 30 
included within the spirit and scope of the invention as 
defined by the appended claims. 
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For a general understanding of the various aspects of the 
present invention, reference is made to the drawings. In the 
drawings, like reference numerals have been used through- 
.out to designate identical elements. The present invention is 
directed to methods and apparatus for designing and imple- 
menting 1-to-N bit image enhancement filters. The design 
method includes computer-aided design of template-based 
stack filters that generate gray-level slices of an output 
image. 43 

FIG. 1 shows an example stack representation of an image 
signal in one dimension. Generally, the gray-scale input 
signal is decomposed, using threshold decomposition, into 
binary slices, represented in the figure as level slices 1, 2, 
and 3. The gray-scale signal of the example illustrated is 50 
limited to 4 possible levels: 0, 1, 2, 3. The individual level 
slices add or stack to form the various signal levels of the 
gray-scale image. For any pixel, the I's in Uie slices start 
from the lowest slice (level slice 1 as depicted in FIG. 1) and 
extend to the slice that corresponds to the value of the 55 
gray-scale pixel. That is, a given colunm gives the unary 
representation of the value. Note that Level slice 2 is a subset 
of Level slice 1, and that no gaps (e.g., 1-0- 1) in a column 
of pixels are allowed to occur. This method of signal 
decomposition is known in the field of image processing and ^ 
leads to simplifications in the supporting mathematics and in 
the implementation electronics, where N-1 binary level 
slices levels may be used to represent N gray-scale levels. 

As used herein, a filter is said to be anti-extensive if the 
output is always a subset of the input. On die other hand, the 65 
filter is extensive if the output is always a superset of the 
input. The level-slice stack filters that form a portion of the 



present invention are designed to be either extensive or 
anti-extensive. 

A generalized embodiment for an iteration-based stack 
filter that achieves the 1-to-N bit resolution enhancement of 
the present invention is illustrated in FIG. 2. The binary 
input image 20 is fint passed through a first filter 22 to 
generate the first level slice 24. Binary input 20 may be any 
image represented as a plurality of rasterized binary signals, 
the sources of which include, but arc not limited to, scanned 
or digitized documents and computer generated bitmaps. 
Regardless of the source, binary image 20 may be stored in 
and/or reuieved from memory. The stack filters described 
herein may be look-up table filters, morphological filters, or 
any similar combination of binary-to-binaiy filters that could 
be used to generate the level slices. The output of each filter, 
the level slice, is itself a plurality of binary signals forming 
a binary image. The level slices each represent a prediction 
of the binary image that would have resulted from thresh- 
olding the continuous tone document image (if it was 
available) that was binarized to achieve the binary image. 
Included in continuous-tone images are idealized multiple- 
bit-per-pixel forms of the image that could be constructed or 
obtained through one of several possible methods. As an 
example, the idealized gray-scale image may be obtained by 
averaging down a high addressability binary form of an 
image and the ORing the averaged image with a raorpho- 
logical-like skeleton as black. 

The notation ¥US^(^y_^y^, as used in FIG. 1, denotes the 
filtering of binary image x to obtain binary image y. As a 
result of processing by the first filter, first level slice 24 is 
produced, representing what is predicted to be the equivalent 
level slice for a gray-scale image from that die binary input 
image was derived. Subsequentiy, the first level slice is 
passed through a second filter 26 to generate second level 
slice 28 in sequence. Moreover, as illustrated in FIG. 2, the 
process is repeated N-1 times, where FILT(^.2)_(/v-i)30 
yields slice 32, where N is the number of possible gray-scale 
levels desired in the output image. When the first filtering is 
for die lowest slice then the following filters must be 
anti-extensive so the level slices diminish for higher slices, 
and therefore will property stack. Conversely, when starting 
at the top level, the following filters must be extensive so the 
levels become broader for lower levels. Upon producing the 
level slices for each of the N-1 levels, binary signals for 
corresponding pixels within the individual levels are stacked 
at address block 34 to form a value or address for that pixel. 
When recombined in a rasterized fashion, die plurality of 
pixel values or addresses output from address block 34 
produce an N-bit gray-scale output image 36. 

As illustrated in FIG. 2, each stage 38 of the stack filter 
would require a buffer with memory for as many scanJines 
as the height of its filter window. Hence the initial pipeline 
delay is the sum of the delays of the individual stages, where 
die delay is die resiilt of time required to establish context 
for the filters, but the throughput is the same as Uiat of the 
slowest stage rather than that of the sum of the stages. It is 
also noted that in an alternative embodiment, die implemen- 
tation of the stack filter can be fully or partially parallelized 
using an architecture similar to that depicted in FIG. 2. 
However, a non-pipelined architecture would require storing 
die entire image bitmap between stages. The buffers of the 
pipelined embodiment typically require less total memory. 

Witiiin the individual filter stages are binary operators, 
such as morphological filters, template-matching filters, or 
other logic-based filters. These binary fillers are independent 
to the degree that they can be designed one at a time instead 
of simultaneously, as described herein. Therefore the indi- 
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vidual filters can be reasonably complex, using at least 
32-pixel templates or windows, as opposed to the 5-pixel 
templates described by Loce and Dougherty. *'The Mean- 
Absolute-Error Theorem for Computational Morphology" 
Proc. SPIE. Vol. 2030. San Diego, July 1993. Filtering the 5 
output of a previously applied filter tends to lower the 
accuracy of the results as compared to a simultaneously 
designed filter, however, this is overcome by the large gain 
in accuracy that results from the increased window size. 

FIGS. 3 and 4 illustrate two alternatives to the generalized jq 
embodiment of FIG. 2, where anti-extensive filten consist of 
template-matching stages implemented using look-up tables 
(LUT's) 40 coupled with logical AND*s 42 and INVERT'S 
44, More specifically, FIG. 3 employs lookup tables 40 that 
generate an INVERT of the difference image 46 between the 
two given levels. The invenion. coupled with the AND 
ensures that the levels properly stack. By performing, in 
effect, a set subtraction filtering, Level 2 is a subset of Level 
1, etc., and the sequence of operations for a given level 
forms an anti-extensive filter. FIG. 4 is an alternative LUT 
filtering embodiment for obtaining gray level slices. This ^ 
embodiment is useful whenever the difference between 
levels is relatively smaD. In such situations, a trade-off can 
be made and a small LUT can perform the task, because it 
only needs to identify difference pixels. The resulting incre- 
mental "cost" is the additional INVERT operation. Note that 
other combinations of logical operations coupled with look- 
up-table-iype filters can be made to be extensive or anti- 
extensive. The preferred embodiment for a particular appli- 
cation is largely dependent upon the available computing 
architecture. 

Similarly. FIG. 5 illustrates an extensive filter embodi- 
ment of the generalized architecture depicted in FIG. 2. Like 
the embodiments of FIGS. 3 and 4, the LUT 40 is used to 
generate the gray level slices at each extensive filtering stage ^5 
39. More specifically, the LUT*s generate the difference 
image between the two given levels, for example, between 
the binary input image and Level slice N-1 . OR operation 50 
ensures that the levels property stack; by performing, in 
effect, set union filtering, where Level N-2 is a superset of 
Level N-1, etc., so that the sequence of operations for a 
given layer form an extensive filter. 

When employing template-matching filters, the look-up 
table of templates may consist of many fewer entries when 
the templates are chosen to only identify pixels tiiat are to be 45 
changed, as opposed to identifying all pixels that should be 
a binary 1 or 0 in the output That is why die difference 
images are generated by the filter. Moreover, morphological 
filters could be used instead of template matching. These 
variants to the illustrated embodiments can also be pipe- 50 
lined, reducing total memory requirements, and in a hard- 
ware implementation, improve total throughput. 

Turning next to FIG, 6, where a preferred method of 
performing iteration-based stack filtering is illustrated, the 
binary image 20 may be filtered by one or more extensive 55 
filler stages 39. or anti-extensive filter stages 38. As 
described above, the level slices from the various filter 
stages are combined by address block 34 to produce gray- 
scale image 36. The embodiment shown in FIG. 6 is 
preferred because extensive filters are used to generate slices 60 
that are broader than the input binary image and anti- 
extensive filters are used to generate slices that are dimin- 
ishing. This embodiment allows for fewer estimation steps 
for any given slice, thus increasing performance in both 
accuracy and speed. Furthermore, the single pipeline 65 
embodiment previously discussed is split into two parts, 
reducing the pipeline latency (time for the first pixel out). 



while steady state throughput is imchanged. From the itera- 
tive-stack architecture shown here, we can see that the stack 
filtering paradigm is a natural setting for binary to gray-scale 
conversion. Each filter employed in the process is a binary, 
or logical, operator. This leads to design and implementation 
simplification over arithmetic averaging and other related 
schemes. Employing iteration in the filter architecmre has 
reduced the combinatoric complexity encountered by Loce 
and Dougherty, allowing filters with larger windows to be 
designed by the present invention. 

Each of the individual filters is designed using training 
sets of images and the statistical principles as described in 
"Method for Statistical Generation of Density Preserving 
Templates for Print Enhancement." R. Loce, application Ser. 
No. 08/169,565. filed Dec. 17. 1993, and "Automated Tem- 
plate Design Method for Print Enhancement," R. Eschbach, 
application Ser. No. 08/169,483, bodi of which are hereby 
incorporated by reference for their teachings. An example of 
the design procedure for two slices of die filter of FIG. 4 is 
shown in FIG. 7, The filter design process starts with an 
ideal gray-scale image 70, for example, one tiiat could be 
obtained from a page description language (PDL) such as 
PostScript™ (Adobe)input by generating a high address- 
ability binary image and then scaling to normal resolution 
and multibit pixels. The gray image is then thresholded at 
step 72 to a level T^ generating a binary image 74 that is 
statistically similar to the binary images that are expected to 
be encountered in operation of the stack filter. Thresholding 
is also performed at steps 76 and 80 to generate the desired 
level slices 78 and 82, respectively, using thresholds Tj and 
Tj. where Tb<T^<^2- Th^ template set for Level 1 is 
obtained by first generating a difference image using XOR 
operation 84 to produce difference image 86, and then the 
difference image and the original binary image are input to 
a template-design program 88 similar to that disclosed by R. 
Eschbach in application Ser. No. 08/169,483, previously 
incorporated herein by reference. The output of the template 
design program is a set of templates, represented in FIG. 7 
as LUTi 90, tiiat can filter a binary image to generate a 
difference image for Level slice 1 and have a minimum 
number of pixels in error. 

A second look-up table of templates, LUT2, indicated by 
reference numeral 92, is designed by applying the first 
look-up table, LUTj to the binary image at step 94. The 
difference image 96 of this filter-obtained slice 1, and slice 
2 obtained by applying threshold Tj, are used in die template 
design program to generate LUTj. Specifically, difference 
image 96 is inverted, step 98, and dien ANDed witii binary 
image 74, step 100, to produce the Level slice 1 filtered 
image. 102, That image is then XORed with the Level slice 
2 image generated using threshold T^, at step 104, to 
produce the difference image 106. As before, difference 
image 106 and Level slice 1 filtered image 102 are input to 
a second instance of template-design program 88. Using the 
second instance of template design program 88, the second 
look-up table of templates, , 92. is designed. Subsequent 
look-up tables, LUT„, could be generated using a similar 
process. 

The above-described method for creating the training set 
may be considered an orthographic technique because of the 
PDL source of the images. Training sets may also be created 
for die reprographic setting by. for example, using scanned 
images where initial quantization is to 8 bits and appropriate 
thresholding follows. 

Considering performance, it has been demonstrated that 
Uie filter embodiments described can perform well when 
transforming text firom 1 to 2 bits per pixel for output 
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enhancement purposes. It is further believed that this itera- 
tion-based filter will, perform well when there are small 
diflferences between level slices and when the difference 
pixels occur in structured areas. Also, in practice, the filter 
would likely be limited to generating a few bits per pixel 5 
because of potential estimation errors that can occur when 
using filtered output as the input to the other filtering stages; 
as described with respect to FIG. 7. 

As previously described, the stack filters are constructed 
so that there are no "gaps" between the level slices. How- 
ever, abandoning the no-g^ criterion of "slacking" leads to 
an alternative electronic architecture, where parallel filters 
could operate directly on the binary image to produce slices 
that are subsequently added together. The trade-off is a more 
complex operation (add or max as opposed to stack) but a 
faster implementation (parallel instead of serial). As illus- 
trated in FIG. 8, a plurality of parallel look-up tables 40, may 
be employed to provide input to an Adder 120, the output of 
which is the multi-level gray-scale image 36. An additional 
advantage here is that all filtering is performed directly on 
the binary input image and estimation eirors will not com- 
pound as could happen in the iterative embodiment. Design 
of the "adding" filter or adder is straightforward; training is 
performed directly between the binary image and a given 
level slice. For most text and line art training sets likely to 
occur in practice, the parallel or adding version of FIG. 8 ^ 
would provide images that stack according to the original 
criterion, however stacking can only be guaranteed for a 
restricted set of images. 

A parallel version of the stack filter can be designed that 
does satisfy the "no gap" criterion. One method of achieving 
this is by employing a different type of iteration in the design 
process. If the anti-extensive 5 aspect of the filter is first 
considered, design begins by generating a first anti-exten- 
sive filter by the methods described above. A second anti- 
extensive filter is then designed by the training method of 
RG. 7. but in the present case all the templates that identify 
difference pixels for the first filtering must be present in the 
second filter. In this design stage more difference identifying 
templates are added to the previously designed filter. TTie ^ 
filter design program then takes as input the filter for 
generating the level slice 1 image, the binary input image, 
and the ideal second level slice. The general rule for titis 
particular design method is that filters for higher layers must 
contain the difference identifying templates of the layer 
below. For successive extensive fillers, difference identify- 
ing templates are removed from the look-up tables. Thus, in 
the parallel embodiment of the iterative slack filter, the 
design process is performed iteratively in a maimer that 
ensures proper stacking when applied in parallel. 

Yet another version lies intermediate between the version 
of FIG. 7 and the fully parallel version, described previously 
and shown in FIG. 8. This is a tree-based version, in which 
a primary filter operates on level 50%, where the output 
thereof feeds at least two secondary filters. For example, a 55 
pair of filters that operate on levels 25% and 75%. Then the 
first of the secondary filters feeds two tertiary filters oper- 
ating on levels 12.5% and 37.5%, and so on. Again there is 
no guarantee of stacking, but in practice it is expected to 
work for most training sets. Having an intermediate archi- go 
lecture, this filter has intermediate virtues in the way of 
minimizing compounding errors and stacking gap errors. A 
pipelined implementation of the tree-based version would 
have lower latency than .the version of FIG. 7, and the same 
throughput as the fully parallel version of FIG. 8. ^5 

In the above-described method for designing and imple- 
menting 1-to-N bit image enhancement filters, computer- 
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aided selection of a set of templates for each "gray level 
slice" of the output image is used. The templates for a given 
level slice identify pixels that are to be changed when 
transforming from the binary bit map to that level slice and 
the level slices are "slacked" to form the final image. The 
design and implementation schemes are general in that they 
can be used for a range of gray levels and template sizes. 
Several variations can be rapidly designed and adapted to 
the budget and performance needs of a given product 
configuration. This design method designs the filler for each 
slice in a somewhat independent manner, hence avoiding the 
compulation limitation of die method of Lx)ce and Dough- 
erty, and enabling templates with at least 32 pixels. 

While the general design procedure for the template 
look-up tables (LUTfe) has been described, an example of the 
filter design embodiment for a 1 -to-2-bit conversion filter is 
shown in FIG. 9, where Ti<Tfl<T2<T3. As described herein, 
the level stacking step operates such that pixels that have 
value 0 in all level slices are treated as while, pixels that 
have a 1 in only level slice 1 are treated as light gray, pixels 
that have Ts in only levels 1 and 2 are treated as dark gray, 
and pixels that have Ts in all slices are treated as black. 
Also, as with FIG. 7, operations or steps witiiin the process 
are enclosed in circles or ellipses, objects are in boxes, and 
die output look-up tables are in shaded boxes. 

More specifically, ideal gray-scale image 150 is then 
thresholded at step 152 using threshold level T^, to generate 
binary image 154. Thresholding is also performed at steps 
156, 158 and 160 to generate the desired level slices 162, 
164 and 166, respectively, using thresholds T,, Tj and T3. 
The template set for Level 2 is obtained by first generating 
a difference image using XOR operation 170 to produce 
Level slice 2 difference image 172, and then difference 
image 172 and binary image 154 are input to a template- 
design step 174, as previously described. The output of the 
template design step is a set of templates, represented in 
FIG. 9 as look-up table 176 (LUT2). tiiat can filter a binary 
image to generate a difference image for Level slice 1 and 
have a minimum number of pixels in error. 

Using LUTj, a second look-up table of templates, LUT3. 
indicated by reference numeral 194. is designed by applying 
LUT2 to die binary image at step 178. The Level 2 difference 
image 180 is then INVERTed at step 182 and Uien ANDed 
with binary image 154 at step 184 to produce the Level slice 
2 filtered image, 186. Filtered image 186 is then XORed 
witii the Level slice 3 image generated using tiireshold T3, 
at step 188, to produce the Level slice 3 difference image 
190. As before, difference image 190 and Level slice 2. 
filtered image 186 are input to a second instance of the 
template-design program, 192. During template design step 
192, the LUT3 templates. 194. are designed. 

In a "parallel" process, threshold step 156 is used to 
generate Level slice 1 image 162, which is supplied as an 
input to be XORed with binary image 154 at step 200. The 
output of XOR step 200 is die Level slice 1 difference image 
202. Subsequentiy difference image 202 and binary image 
154 are inputs to a third instance of the template-design 
program, 204, the output of which are the templates forming 
LUT,, indicated by reference numeral 206. In one design 
example the templates were resuicted in size to a 5x5 
window, and 2545, 2014, and 4750 templates were 
employed in LUT,. LUTj and LUT3, respectively. In prac- 
tice, the number of templates in each look-up table could be 
reduced through logic minimization, synmietry analysis, and 
culling out templates that only marginally add to the 
enhancement capability based upon a statistical analysis. 
Note that these filters may be rapidly redesigned for a greater 
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number of bits per pixel, larger window size, difFerent image 
types, or possibly to treat halftones in some special manner. 

A method for obtaining a 2-bit per pixel bit map using the 
LUTs of FIG. 9 is shown in FIG. 10. Specifically, a light gray 
level slice is generated by feeding binary image 20 to a first 5 
look-up table, 222. The resulting Level slice 1 difference 
image is then ORed, block 224, with binary image 20 to 
produce the light gray level slice. The light gray level slice 
information is passed to stacking block 226, where it will be 
stacked with additional level slice data. The dark gray level jq 
slice is generated in a similar manner, where binary image 
20 is input to a 'second look-up table, 230. Look-up table 
230 in turn generates an inverted difference image that is 
passed to inverter 232 prior to being ANDed with the binary 
image at block 234. The resulting output from AND block 
234 is passed to both stacking block 226 and to the input of 
the third look-up table 238. Operating on the dark gray 
image slice, look-up table 238 generates an inverted differ- 
ence image which is first inverted at block 240 and then 
ANDed with the dark gray image slice at block 242. The 
output of AND block 242 is also passed to stacking block 
226. As inconsistencies may existing in the speed at which 
each leg of the stack filter operates, synchronization and/or 
temporary buffering of the binary level slice data within the 
stacking block is preferred. 

When all binary level slice data is available for a particu- 
lar pixel, the data is stacked to form a 2-bit word using a 
process that is essentially the reverse of that illustrated in 
FIG. 1. Table A summarizes the stacking operation carried 
out in block 226, where the binary signal for common 



TABLE A 



Black Level 


Dark Gray 


Light Gray 


Gray Output 


Slice 


Level Slice 


Level Slice 


(binary) 


0 


0 


0 


00 


0 


0 


1 


01 


0 


1 


1 


10 


1 


1 


1 


U 



20 



25 



30 



35 



pixel positions are "stacked" to determine the resulting 40 
gray-scale output level shown in the right-most colimm and 
represented as output 244 in FIG. 10. 

RGS. 11 and 12 illustrate several methods for printing the 
resulting 2-bit per pixel gray-scale bit map. FIG. 11 is 
straightforward, but requires a 2-bil per pixel marking 45 
device 250. The method of FIG. 12 utilizes the same 2-bit 
per pixel gray-scale signals to drive a marking device, such 
as a raster output scanner (RGS) employing a laser, but 
employs further image processing functions to generate the 
video signals. 50 

In the printing embodiment of FIG. 12 the 3x linear 
scaling at block 260 is performed only in the fast scan 
direction of the bit map. Note that after the scaling and 
thresholding to binary, block 262, the image could be output 
using a printing apparatus having the capability for high 55 
addressability, for example, the apparatus described in U.S. 
Pat. application No. 08/118,858 (D/93197), filed Sep. 10, 
1993, and hereby incorporated by reference for its teachings 
with respect to high addressability printing. Generally, the 
scaled and thresholded data would be grouped into serial 60 
strings of three bits, block 264, and the image, represented 
as a series of 3-bit strings, image 268, would be used to drive 
the pulse-width position modulated (PWPM) apparams 270 
that produces the video signals to drive the raster output 
scanner. 65 

In recapitulation, the present invention is a method and 
apparatus for the enhancement of l-bit-per-pixel image 



signals to produce a mulfiple-bit-per-pixel form. Briefly, a 
binary input image is passed through a first filter to generate 
a first level slice. The level slice filters described herein are 
implemented as look-up table or template-based filters, 
morphological filters, or any similar binary-to-binary filters 
that could be used to generate the level slices. Hie output of 
each filter, the level slice, is itself a plurality of binary 
signals forming a binary image. The first level slice is then 
passed through a second filter to generate second level slice 
and the process may be repeated to produce N-1 slices, 
where N is the number of possible gray-scale levels desired 
in the output image. Once the slices are generated, the 
resulting binary image data therein is recombined in a 
stacking operation to produce the multiple-bit per pixel 
output. An alternative approach, also presented here is that 
the level slice filters could be applied in parallel and the 
outputs thereof combined by adding or stacking. 

It is, therefore, apparent that there has been provided, in 
accordance with the present invention, a method and appa- 
ratus for producing a 1-to-N bit per pixel enhancement of a 
binary bitmap image, and more particularly to the use of 
template matching stack filters to produce such enhance- 
ments. While this invention has been described in conjunc- 
tion with preferred embodiments thereof, it is evident that 
many alternatives, modifications, and variations will be 
apparent to those skilled in the art. Accordingly, it is 
intended to embrace all such alternatives, modifications and 
variations that fall within the spirit and broad scope of the 
appended claims. 

We claim: 

1. A method for designing a stack filter, for enhancing a 
binary input image into a multiple-bit per pixel image, 
comprising the steps of: 

(a) obtaining a gray-scale image, wherein the image 
contains structures representative of structures appear- 
ing in documents to be enhanced from a binary to a 
multiple-bit per pixel gray-scale resolution; 

(b) thresholding the gray-scale image using a binary 
threshold level to produce a binary image; 

(c) thresholding the gray-scale image at second threshold, 
preferably not equal to the binary threshold, to produce 
a first level slice; 

(d) producing, as a function of the binary pixel levels in 
the binary image and the first level slice, a first differ- 
ence image; and 

(e) generating, as a fiinction of the first difference image 
and the binary image, a first level-slice filter having a 
plurality of templates which, upon receiving binary 
input signals in a pattern similar to that within a 
windowed subset of pixel locations within the binary 
image, will produce binary output signals .equivalent to 
a corresponding pixel position in the first difference 
image. 

2. The method of claim 1, wherein the step of producing 
a first difference image includes XORlng the binary pixel 
levels in the first level slice with the binary pixel levels in the 
binary image to produce the difference image. 

3. Tht method of claim 1, further including the step of 
designing a second level-slice filter, said second level-slice 
filter designing step comprising the steps of: 

(a) thresholding the gray-scale image at a second thresh- 
old, preferably not equal to the binary threshold, to 
produce a second level slice; 

(b) applying the first level-slice filter to the binary image 
to produce a filtered difference image; 

(c) inverting the filtered difference image to produce an 
inverted image; 
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(d) ANDing the binary pixel levels in the filtered differ- 
ence image with the binary pixel levels in the binary 
image to produce a filtered level slice; 

(c) producing, as a function of the binary pixel levels in 
the second level slice and the filtered level slice, a ^ 
second difference image; and 

(f) generating, as a function of the second difference 
image and the filtered level slice, a second level-slice 
filter having a plurality of templates which, upon iq 
receiving binary input signals in a pattern similar to that 
within a windowed subset of pixel locations widiin the 
second level slice, will produce binary output signals 
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equivalent to a conesponding pixel posidon in the 
second difference image. 

4. The method of claim 1, wherein the step of producing 
a second difference image includes XORing the binary pixel 
levels in the second level slice with the binary pixel levels 
in the filtered level slice to produce the difference image. 

5. The method of claim 1, wherein the step of obtaining 
a gray-scale image includes the step of producing an ideal- 
ized gray-scale image by averaging down a high address- 
ability form of the gray-scale image and ORing it with a 
morphological skeleton. 

* * * * ♦ 
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